Degenerate Stochastic Control Problems with ExponentialCosts and Weakly Coupled Dynamics: Viscosity Solutions and a Maximum Principle
نویسندگان
چکیده
This paper considers a class of optimization problems arising in wireless communication systems. We analyze the optimal control and the associated Hamilton–Jacobi–Bellman (HJB) equations. It turns out that the value function is a unique viscosity solution of the HJB equation in a certain function class. To deal with the fast growth condition of the value function in establishing uniqueness, we construct particular semiconvex/semiconcave approximations for the viscosity sub/supersolutions, and obtain a maximum principle on unbounded domains. The localized envelope function technique introduced in this paper permits an analysis of the uniqueness of viscosity solutions defined on unbounded domains in cases with very general growth conditions when combined with appropriate system dynamics. The optimization problem with state constraints is also considered.
منابع مشابه
Se p 20 05 On some recent aspects of stochastic control theory and their applications ∗
This paper is a survey on some recent aspects and developments in stochastic control theory. We discuss the two main historical approaches, Bellman’s optimality principle and Pontryagin’s maximum principle, and their modern exposition with viscosity solutions and backward stochastic differential equations. Some original proofs are presented in a unifying context including degenerate singular co...
متن کامل2 00 5 On some recent aspects of stochastic control and their applications ∗
This paper is a survey on some recent aspects and developments in stochastic control. We discuss the two main historical approaches, Bellman’s optimality principle and Pontryagin’s maximum principle, and their modern exposition with viscosity solutions and backward stochastic differential equations. Some original proofs are presented in a unifying context including degenerate singular control p...
متن کاملGradient bounds for nonlinear degenerate parabolic equations and application to large time behavior of systems
We obtain new oscillation and gradient bounds for the viscosity solutions of fully nonlinear degenerate elliptic equations where the Hamiltonian is a sum of a sublinear and a superlinear part in the sense of Barles and Souganidis (2001). We use these bounds to study the asymptotic behavior of weakly coupled systems of fully nonlinear parabolic equations. Our results apply to some “asymmetric sy...
متن کاملNumerical Solution of Weakly Singular Ito-Volterra Integral Equations via Operational Matrix Method based on Euler Polynomials
Introduction Many problems which appear in different sciences such as physics, engineering, biology, applied mathematics and different branches can be modeled by using deterministic integral equations. Weakly singular integral equation is one of the principle type of integral equations which was introduced by Abel for the first time. These problems are often dependent on a noise source which a...
متن کاملOptimal Control of Nonlinear Systems with Controlled Transitions
This paper studies the optimum stochastic control problem with piecewise deterministic dynamics. The controls enter through the system dynamics as well as the transitions for the underlying Markov chain process, and are allowed to depend on both the continuous state and the current state of the Markov chain. The paper shows that the feedback optimal control relies on the viscosity solutions of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- SIAM J. Control and Optimization
دوره 44 شماره
صفحات -
تاریخ انتشار 2005